Using Network Coding (NC) can effectively improve the reliability of data delivery in Energy Harvesting Wireless Sensor Network (EH-WSN). Most of the existing research used fixed Data Rate (DR) and fixed Maximum Number of Retransmissions (MNR) in reliable data delivery, and its end-to-end delay is long. In order to reduce the data delivery delay, a data delivery scheme, which combined the energy harvesting characteristics of EH-WSN node and the link quality between the adjacent nodes, was proposed to obtain low end-to-end delay by optimizing the DR and the MNR. The energy harvesting process and the energy consumption were modeled and the residual energy equation of node was given. The probability of successfully transmitting a packet under the retransmission mechanism was derived by modeling the link quality between the adjacent nodes, and the transmission delay over a hop on the data delivery path was also derived. The proposed scheme can minimize the transmission delay of each hop by optimizing the DR and the MNR based on the optimization equation under the condition that the node can satisfy the constraints of link quality and residual energy. The experimental results show that compared with the fixed DR and fixed MNR data delivery scheme, the proposed scheme can obtain the lowest end-to-end data delivery delay.